Skip to content

Rope Fix for a single subfunction signature#880

Merged
quic-hemagnih merged 13 commits intoquic:mainfrom
abhishek-singh591:rope_fix_subfunction
Mar 26, 2026
Merged

Rope Fix for a single subfunction signature#880
quic-hemagnih merged 13 commits intoquic:mainfrom
abhishek-singh591:rope_fix_subfunction

Conversation

@abhishek-singh591
Copy link
Contributor

@abhishek-singh591 abhishek-singh591 commented Mar 24, 2026

Summary

This PR introduces the Rotary Position Embedding (RoPE) fix, ensuring that models generate a single unified subfunction signature during ONNX export.

Models Status After Applying the Fix

Models now producing a single subfunction signature

All causal LMs tested in the associated test file are functioning correctly, except those listed below.

Models still producing two different subfunction signatures

The following models continue to emit multiple subfunction signatures and require additional investigation:

  • Phi-1
  • StarCoder2
  • CodeGen

Models with issues unrelated to the RoPE fix

These models have separate problems that need to be addressed independently:

  • Granite-MoE
  • GPT-OSS
  • Mixtral

Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
ochougul and others added 7 commits March 25, 2026 09:35
Signed-off-by: Onkar Chougule <ochougul@qti.qualcomm.com>
Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
Signed-off-by: abhishek-singh591 <sabhis@qti.qualcomm.com>
@quic-hemagnih quic-hemagnih merged commit 895d987 into quic:main Mar 26, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants